Device, method and computer readable recording medium containing program for separating image components

ABSTRACT

A problem inherent to radiographic images, which may occur when an independent component analysis technique is applied to energy subtraction carried out on radiographic images, is solved to achieve separation of image components to be separated with higher accuracy. As preprocessing before the independent component analysis, a spatial frequency band which contains the components to be separated is extracted, pixels of the radiographic images are classified into more than one subsets for each radiographic image based on a value of a predetermined parameter, and/or nonlinear pixel value conversion is applied to the radiographic images based on a value of the predetermined parameter. Alternatively, nonlinear independent component analysis is carried out according to a model using the predetermined parameter.

This application is a continuation of U.S. application Ser. No.12/190,743, filed Aug. 13, 2008, which claims priority to JP2007-211762, filed Aug. 15, 2007, and JP 2008-148849, filed Jun. 6,2008, each of which is incorporated herein by reference in its entirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a device and a method for separatingparticular image components using more than one radiographic imageswhich are taken with radiations having different energy distributions,and a computer readable recording medium containing a program forcausing a computer to carry out the method.

2. Description of the Related Art

A technique called energy subtraction has been known in the field ofmedical image processing. In this technique, two radiographic images ofthe same subject are taken by applying radiations having differentenergy distributions to the subject, and image signals representingcorresponding pixels of these radiographic images are multiplied withsuitable weighting factors and subtraction is carried out between pairsof the corresponding pixels of the images to obtain difference signals,which represent an image of a particular structure. Using thistechnique, a soft part image formed by removing the bone component fromthe inputted images or a bone part image formed by removing the softpart component from the inputted images can be generated. Using an imagefrom which parts that are not of interest in diagnosis have been removedfor image interpretation, visibility of the part of interest in theimage is improved (see, for example, U.S. Pat. No. 6,421,419).

A technique called Independent Component Analysis (ICA) is known. Thistechnique is used to separate a plurality of statistically-independentunknown component signals from a plurality of known observation signals.This technique is applied, for example, to extract voices of respectivepersons (component signals) from recorded contents (observation signals)which have been obtained by recording the voices of the persons througha plurality of microphones.

It is suggested that this independent component analysis technique isapplicable to the above-described energy subtraction. Specifically, anabsorption spectrum of a radiation varies depending on the energy levelthereof and/or the component of a subject, such as soft parts or bones.That is, a radiographic image obtained by exposure to radiation is amixture of different component images. Therefore, it is suggested thatthe independent component analysis technique may be applied to theenergy subtraction to separate a plurality of image components(component signals), which represent soft parts and bones, from tworadiographic images (observation signals) obtained with radiationshaving different energy distributions as described above (InternationalPatent Publication No. WO03/073064).

In the independent component analysis technique, it is assumed that thecomponent signals to be separated are statistically independent fromeach other and that the component signals contained in the observationsignals are mixed at constant ratios. In practice, however, it isdifficult to satisfy such preconditions, and the individual componentsignals may not always be restored appropriately.

Therefore, the above-mentioned International Patent Publication No.WO03/073064 proposes a partial independent component analysis approach,in which, when gene expression profiling using cDNA microarrays iscarried out according to the independent component analysis, theindependent component analysis is applied on a gene informative indexsubspace containing only differentially expressed genes, rather thanusing a gene informative index space (the entire observation signal)which contains genes causing separation error, to separate expressionlevels of the genes (component signals) supplied by malignant andstromal cells. In this approach, component signals obtained through theindependent component analysis applied on the entire gene informativeindex space are repeatedly evaluated according to a predeterminedmeasure to identify a gene informative index subspace, which satisfiesthe statistical independence condition for the component signals, fromthe entire observation signal.

The above-mentioned International Patent Publication No. WO03/073064,however, does not teach or suggest a problem and a solution which areinherent to the independent component analysis or the partialindependent component analysis being applied to the energy subtractioncarried out on radiographic images.

SUMMARY OF THE INVENTION

In view of the above-described circumstances, the present invention isdirected to providing a device, a method and a computer readablerecording medium containing a program which more appropriately apply theindependent component analysis technique to the energy subtractioncarried out on radiographic images.

A first aspect of the image component separation device of the inventionincludes: component separating means for separating more than one imagecomponents from more than one radiographic images inputted thereto, theimage components respectively representing more than one predeterminedcomponents in a subject, each radiographic image being formed byradiation transmitted through the subject, each radiographic imagerepresenting degrees of transmission and attenuation through the subjectof each of different patterns of radiation having different energydistributions, the component separating means separating the imagecomponents by calculating weighted sums using predetermined weightingfactors for each corresponding pixel among the radiographic images; andfurther includes band extracting means for extracting, from each of theradiographic images, an image component of a spatial frequency bandcontaining the predetermined components, wherein the componentseparating means carries out independent component analysis on the imagecomponents of the spatial frequency band extracted by the bandextracting means to obtain separation factors for separating the morethan one image components from the image components of the spatialfrequency band and uses the separation factors as the predeterminedweighting factors.

A first aspect of the image component separation method of the inventionincludes: a component separating step to separate, using a computer,more than one image components from more than one radiographic imagesinputted thereto, the image components respectively representing morethan one predetermined components in a subject, each radiographic imagebeing formed by radiation transmitted through the subject, eachradiographic image representing degrees of transmission and attenuationthrough the subject of each of different patterns of radiation havingdifferent energy distributions, the component separating step includingseparating the image components by calculating weighted sums usingpredetermined weighting factors for each corresponding pixel among theradiographic images; and prior to the above step, a band extracting stepto extract, from each of the radiographic images, using the computer, animage component of a spatial frequency band containing the predeterminedcomponents, wherein the component separating step includes carrying outindependent component analysis on the image components of the spatialfrequency band extracted in the band extracting step to obtainseparation factors for separating the more than one image componentsfrom the image components of the spatial frequency band and using theseparation factors as the predetermined weighting factors.

A first aspect of the computer-readable recording medium containing theimage component separation program of the invention contains a programfor causing a computer to carry out the first aspect of the imagecomponent separation method.

A second aspect of the image component separation device of theinvention includes: component separating means for separating more thanone image components from more than one radiographic images inputtedthereto, the image components respectively representing more than onepredetermined components in a subject, each radiographic image beingformed by radiation transmitted through the subject, each radiographicimage representing degrees of transmission and attenuation through thesubject of each of different patterns of radiation having differentenergy distributions, the component separating means separating theimage components by calculating weighted sums using predeterminedweighting factors for each corresponding pixel among the radiographicimages; and further includes subset classifying means for classifyingpixels of the radiographic images into one or more subsets for each ofthe radiographic images based on a value of a parameter, the parameterbeing obtained from at least one of the radiographic images and having apredetermined relationship with a thickness of each of the more than onepredetermined components or a thickness of the subject at each pixel ofthe radiographic images, wherein the component separating means carriesout independent component analysis on at least one group ofcorresponding subsets between the radiographic images to obtainseparation factors for separating the more than one image componentsfrom the subsets, and uses the separation factors as the predeterminedweighting factors.

A second aspect of the image component separation method of theinvention includes: a component separating step to separate, using acomputer, more than one image components from more than one radiographicimages inputted thereto, the image components respectively representingmore than one predetermined components in a subject, each radiographicimage being formed by radiation transmitted through the subject, eachradiographic image representing degrees of transmission and attenuationthrough the subject of each of different patterns of radiation havingdifferent energy distributions, the component separating step includingseparating the image components by calculating weighted sums usingpredetermined weighting factors for each corresponding pixel among theradiographic images; and prior to the above step, a subset classifyingstep to classify, using the computer, pixels of the radiographic imagesinto one or more subsets for each of the radiographic images based on avalue of a parameter, the parameter being obtained from at least one ofthe radiographic images and having a predetermined relationship with athickness of each of the more than one predetermined components or athickness of the subject at each pixel of the radiographic images,wherein the component separating step includes carrying out independentcomponent analysis on at least one group of corresponding subsetsbetween the radiographic images to obtain separation factors forseparating the more than one image components from the subsets, andusing the separation factors as the predetermined weighting factors.

A second aspect of the computer-readable recording medium containing theimage component separation program of the invention contains a programfor causing a computer to carry out the second aspect of the imagecomponent separation method.

A modification of the second aspect of the image component separationdevice of the invention may include: subset classifying means forclassifying pixels of more than one radiographic images into one or moresubsets for each of the radiographic images based on a value of aparameter, the parameter being obtained from at least one of theradiographic images and having a predetermined relationship with athickness of each of more than one predetermined components of a subjector a thickness of the subject at each pixel of the radiographic images,each radiographic image being formed by radiation transmitted throughthe subject, each radiographic image representing degrees oftransmission and attenuation through the subject of each of differentpatterns of radiation having different energy distributions; andcomponent separating means for separating more than one image componentsrespectively representing the more than one predetermined components ofthe subject from the radiographic images by carrying out independentcomponent analysis on each group of corresponding subsets between theradiographic images to obtain, for each group of the subsets, separationfactors for separating each of the image components representing themore than one predetermined components from the subsets, and bycalculating, for each group of the subsets, weighted sums for eachcorresponding pixel among the subsets with using the separation factorsas weighting factors.

Similarly, a modification of the second aspect of the image componentseparation method of the invention may include: a subset classifyingstep to classify, using a computer, pixels of more than one radiographicimages into one or more subsets for each of the radiographic imagesbased on a value of a parameter, the parameter being obtained from atleast one of the radiographic images and having a predeterminedrelationship with a thickness of each of more than one predeterminedcomponents of a subject or a thickness of the subject at each pixel ofthe radiographic images, each radiographic image being formed byradiation transmitted through the subject, each radiographic imagerepresenting degrees of transmission and attenuation through the subjectof each of different patterns of radiation having different energydistributions; and a component separating step to separate, using thecomputer, more than one image components respectively representing themore than one predetermined components of the subject from theradiographic images by carrying out independent component analysis oneach group of corresponding subsets between the radiographic images toobtain, for each group of the subsets, separation factors for separatingeach of the image components representing the more than onepredetermined components from the subsets, and by calculating, for eachgroup of the subsets, weighted sums for each corresponding pixel amongthe subsets with using the separation factors as weighting factors.

Further, a modification of the second aspect of the computer-readablerecording medium containing the image component separation program ofthe invention contains a program for causing a computer to carry out themodification of the second aspect of the image component separationmethod.

A third aspect of the image component separation device of the inventionincludes: component separating means for separating more than one imagecomponents from more than one radiographic images inputted thereto, theimage components respectively representing more than one predeterminedcomponents in a subject, each radiographic image being formed byradiation transmitted through the subject, each radiographic imagerepresenting degrees of transmission and attenuation through the subjectof each of different patterns of radiation having different energydistributions, the component separating means separating the imagecomponents by calculating weighted sums using predetermined weightingfactors for each corresponding pixel among the radiographic images,wherein the component separating means carries out independent componentanalysis on the radiographic images to obtain separation factors forseparating the more than one image components from the radiographicimages and uses the separation factors as the predetermined weightingfactors, and the independent component analysis is carried out withusing a model representing, as a predetermined function, mixing factorsrepresenting mixing ratios of the more than one image components in eachof the radiographic images using a parameter obtained from at least oneof the radiographic images, the parameter having a predeterminedrelationship with a thickness of each of the more than one predeterminedcomponents or a thickness of the subject at each pixel of theradiographic images.

A third aspect of the image component separation method of the inventionincludes: a component separating step to separate more than one imagecomponents from more than one radiographic images inputted thereto, theimage components respectively representing more than one predeterminedcomponents in a subject, each radiographic image being formed byradiation transmitted through the subject, each radiographic imagerepresenting degrees of transmission and attenuation through the subjectof each of different patterns of radiation having different energydistributions, the component separating step including separating theimage components by calculating weighted sums using predeterminedweighting factors for each corresponding pixel among the radiographicimages, wherein the component separating step includes carrying outindependent component analysis on the radiographic images to obtainseparation factors for separating the more than one image componentsfrom the radiographic images and using the separation factors as thepredetermined weighting factors, and the independent component analysisis carried out with using a model representing, as a predeterminedfunction, mixing factors representing mixing ratios of the more than oneimage components in each of the radiographic images using a parameterobtained from at least one of the radiographic images, the parameterhaving a predetermined relationship with a thickness of each of the morethan one predetermined components or a thickness of the subject at eachpixel of the radiographic images.

A third aspect of the computer-readable recording medium containing theimage component separation program of the invention contains a programfor causing a computer to carry out the third aspect of the imagecomponent separation method.

A fourth aspect of the image component separation device of theinvention includes: component separating means for separating more thanone image components from more than one radiographic images inputtedthereto, the image components respectively representing more than onepredetermined components in a subject, each radiographic image beingformed by radiation transmitted through the subject, each radiographicimage representing degrees of transmission and attenuation through thesubject of each of different patterns of radiation having differentenergy distributions, the component separating means separating theimage components by calculating weighted sums using predeterminedweighting factors for each corresponding pixel among the radiographicimages; and further includes pixel value converting means for applyingnonlinear conversion to a pixel value of each pixel of at least one ofthe radiographic images based on a value of a parameter obtained from atleast one of the radiographic images, the parameter having apredetermined relationship with a thickness of each of the more than onepredetermined components or a thickness of the subject at each pixel ofthe radiographic images, the nonlinear conversion bringing theradiographic images closer to achieving a relationship where a ratiobetween radiation attenuations in the radiographic images is constantregardless of the thickness of each predetermined component or thethickness of the subject, wherein the component separating means carriesout independent component analysis on the image converted by the pixelvalue converting means to obtain separation factors for separating themore than one image components from the converted images and uses theseparation factors as the predetermined weighting factors.

A fourth aspect of the image component separation method of theinvention includes: a component separating step to separate more thanone image components from more than one radiographic images inputtedthereto, the image components respectively representing more than onepredetermined components in a subject, each radiographic image beingformed by radiation transmitted through the subject, each radiographicimage representing degrees of transmission and attenuation through thesubject of each of different patterns of radiation having differentenergy distributions, the component separating step including separatingthe image components by calculating weighted sums using predeterminedweighting factors for each corresponding pixel among the radiographicimages; and prior to the above step, a pixel value converting step toapply nonlinear conversion to a pixel value of each pixel of at leastone of the radiographic images based on a value of a parameter obtainedfrom at least one of the radiographic images, the parameter having apredetermined relationship with a thickness of each of the more than onepredetermined components or a thickness of the subject at each pixel ofthe radiographic images, the nonlinear conversion bringing theradiographic images closer to achieving a relationship where a ratiobetween radiation attenuations in the radiographic images is constantregardless of the thickness of each predetermined component or thethickness of the subject, wherein the component separating step includescarrying out independent component analysis on the image converted inthe pixel value converting step to obtain separation factors forseparating the more than one image components from the converted imagesand uses the separation factors as the predetermined weighting factors.

A fourth aspect of the computer-readable recording medium containing theimage component separation program of the invention contains a programfor causing a computer to carry out the fourth aspect of the imagecomponent separation method.

Details of the present invention will be explained below.

A specific example of the “subject” may be a human body. For example, ifthe radiographic images represent the chest of the human body, specificexamples of the “more than one predetermined components (to beseparated)” may be the bone component and the soft part component. The“soft part component” refers to components of connective tissues otherthan bone tissues (bone component) of a living body, and includesfibrous tissues, adipose tissues, blood vessels, striated muscles,smooth muscles, peripheral nerve tissues (nerve ganglions and nervefibers), and the like.

The “more than one radiographic images . . . each radiographic imagebeing formed by radiation transmitted through the subject, eachradiographic image representing degrees of transmission and attenuationthrough the subject of each of different patterns of radiation havingdifferent energy distributions” to be inputted may be obtained by amulti-shot method in which imaging is carried out more than once usingdifferent patterns of radiations having different energy distributions,or may be obtained by a one-shot method in which radiation is appliedonce to more than one storage phosphor sheets stacked one on the othervia an additional filter such as an energy separation filter (they maybe in contact to or separated from each other) so that the energydistribution of the radiation transmitted through the subject in thesingle exposure is varied, and different patterns of the radiationhaving different energy distributions are detected on these sheets.Analog images recorded on the storage phosphor sheets, which representdegrees of transmission of the radiation through the subject, areconverted into digital images by scanning the sheets with excitationlight, such as laser light, to generate photostimulated luminescence,and photoelectrically reading the obtained photostimulated luminescence.Besides the above-described storage phosphor sheet, other means, such asa flat panel detector (FPD) employing CMOS, or the like, may be selectedas appropriate depending on the imaging method and used for detectingthe radiation.

The “group of corresponding pixels between the radiographic images”refers to pixels positionally corresponding to each other with referenceto a predetermined structure (such as a site to be observed or a marker)in the radiographic images. If the radiographic images have been takenin a manner that the position of the predetermined structure in theimages does not shift between the images, the corresponding pixels arepixels at the same coordinates in the coordinate system in therespective images. However, if the radiographic images have been takenin a manner that the position of the predetermined structure in theimages shifts between the images, the images may be aligned with eachother through linear alignment using scaling, translation, rotation, orthe like, nonlinear alignment using warping or the like, or acombination of any of these techniques. It should be noted that thealignment between the images may be carried out using a method describedin U.S. Pat. No. 6,751,341, or any other method known at the time ofputting the invention into practice.

The operation to “separate more than one image components . . .respectively representing more than one predetermined components in asubject . . . by calculating weighted sums using predetermined weightingfactors for each corresponding pixel among the radiographic images”refers to a so-called energy subtraction technique.

For example, assuming that a total amount of the radiation applied tothe subject is E₀, attenuation coefficients determined for therespective components (two components in this example) in the subjectdepending on the energy distribution of the radiation are α and β, andthicknesses of the respective components are t_(a) and t_(b), then, alogarithmic radiation exposure amount E at each pixel of eachradiographic image can be expressed as equation (1) below:E=E ₀−(α·t _(a) +β·t _(b))  (1).Terms α·t_(a) and β·t_(b) at the right side of equation (1) representradiation attenuations in the respective components, and imply that theradiographic image reflects mixed influences of the radiationattenuations in the individual components. Each of the terms α·t_(a) andβ·t_(b) is a product of the attenuation coefficient and the thickness ofthe component, and this implies that the radiation attenuation at eachcomponent is dependent on the thickness of the component. In equation(1), assuming that E′=E₀−E, equation (1) can be simplified as equation(2) below:E′=α·t _(a) +β·t _(b)  (2).

Since the two radiographic images to be inputted in the invention havedifferent radiation energy distributions, values of the attenuationcoefficients differ between the images. Therefore, a suffix “1” or “2”is added to identify each radiographic image, and equation (2) for eachradiographic image can be expressed as equations (3) and (4) below:E′ ₁=α₁ ·t _(a)+β₁ ·t _(b)  (3),E′ ₂=α₂ ·t _(a)+β₂ ·t _(b)  (4).

Based on this model, the operation to separate each component in theimages by combining weighted images in the invention means to obtainrelational expressions that are independent from the thickness of thecomponent other than the component to be separated by multiplying therespective terms in each of the above equations with appropriateweighting factors to calculate a weighted sum, so that values of thecoefficient parts of the terms corresponding to the component other thanthe component to be separated become 0. Therefore, in order to separatea certain component in the image, it is necessary to determine theweighting factors such that the coefficient part of the termcorresponding to the component other than the component to be separatedon the right side of each equation becomes 0.

The logarithmic exposure amount E of the radiographic image is a valueobtained by log-transforming an amount of the radiation that hastransmitted through the subject and reached the radiation detectingmeans during imaging of the subject. The exposure amount can be obtainedby directly detecting the radiation reached the radiation detectingmeans; however, it is very difficult to detect the exposure amount ateach pixel of the radiographic image. Since a pixel value of each pixelof the image obtained on the radiation detecting means is larger as theexposure amount is larger, the pixel values and the exposure amounts canbe related to each other. Therefore, the exposure amounts in the aboveequations can be substituted with pixel values.

The “independent component analysis” is a technique to separate morethan one statistically-independent unknown component signals from morethan one known observation signals. That is, the component signals arefound from the inputted known observation signals such that thestatistical independence between the component signals is maximized.

For example, assuming that there are observation signals x₁ and x₂ eachcontaining mixed two statistically-independent component signals s₁ ands₂, as in equations (5) and (6) below:x ₁(t)=a ₁₁ s ₁(t)+a ₁₂ s ₂(t)  (5),x ₂(t)=a ₂₁ s ₁(t)+a ₂₂ s ₂(t)  (6),wherein, a₁₁, a₁₂, a₂₁ and a₂₂ are mixing factors representing mixingratios of the component signals s₁ and s₂ in the respective observationsignals x₁ and x₂.Rewriting the equations (5) and (6) as:

${X = \begin{pmatrix}x_{1} \\x_{2}\end{pmatrix}},{A = \begin{pmatrix}a_{11} & a_{12} \\a_{21} & a_{22}\end{pmatrix}},{S = \begin{pmatrix}s_{1} \\s_{2}\end{pmatrix}},$then, equation (7) below is obtained:X=AS  (7).Assuming that an inverse matrix of the matrix A is W, the componentsignals s₁ and s₂ can be restored by calculating equation (8) below:S=WX  (8).Components in the matrix W are separation factors for separating thecomponent signals s₁ and s₂ from the observation signals x₁ and x₂.

In the independent component analysis, independence between thecomponent signals s₁ and s₂ is evaluated according to various criteria,and the separation factors (matrix W) and the component signals s₁ ands₂ are calculated such that the independence between the componentsignals s₁ and s₂ is maximized.

Comparing equations (3) and (4) with equations (5) and (6), theradiographic images (E′₁, E′₂) in the invention correspond to theobservation signals x₁ and x₂, the components (t_(a), t_(b)) to beseparated in the subject correspond to the component signals s₁ and s₂,and the attenuation coefficients α₁, β₁, α₂ and β₂ correspond to themixing factors a₁₁, a₁₂, a₂₁ and a₂₂. Therefore, by carrying out theindependent component analysis on the radiographic images (E′₁, E′₂),which correspond to the observation signals, the more than one imagecomponents representing the more than one predetermined components(t_(a), t_(b)) in the subject, which correspond to the componentsignals, can be obtained. The separation factors (matrix W) obtained atthis time are used as the weighting factors for calculating weightedsums of the inputted radiographic images.

As examples of the criteria for evaluating the independence in theindependent component analysis, negative entropy and mutual informationare known. As specific examples of the processing method for determiningthe independent components such that the independence therebetween ismaximized, a fixed-point approach and a gradient method are known. Inthe invention, any of these known methods can be selected to be appliedas appropriate.

It should be noted that the number of component signals to be found inthe independent component analysis is not more than the number of theobservation signals. Therefore, in the invention, it is necessary toprepare the radiographic images of the number which is not less than thenumber of the components to be separated in the subject.

The independent component analysis includes linear independent componentanalysis, in which the mixing factors (matrix A) are always constant,and nonlinear independent component analysis, in which the mixingfactors are defined by a parameter and are not always constant. Thethird aspect of the invention corresponds to an aspect in which thenonlinear independent component analysis technique is applied.

As a specific example of the operation to “extract, from each of theradiographic images, an image component of a spatial frequency bandcontaining the predetermined components” in the first aspect of theinvention, in a case where the image components representing the bonecomponent and the soft part component are separated from theradiographic images of the human body, which is the subject, an imagecomponent of the medium frequency band that includes the spatialfrequency band corresponding to the thickness of the bone of the humanbody may be extracted.

Specific examples of the “parameter being obtained from at least one ofthe radiographic images and having a predetermined relationship with athickness of each of the more than one predetermined components or athickness of the subject at each pixel of the radiographic images” inthe second, third and fourth aspects of the invention may include aradiation amount at each pixel of one of the radiographic images, alogarithmic value of the radiation amount, a difference betweenlogarithmic values of radiation amounts at each pair of correspondingpixels between two of the radiographic images, and a logarithmic valueof a ratio between radiation amounts at each pair of the correspondingpixels. It should be noted that the logarithmic value of the radiationamount can be replaced with a pixel value at each pixel of each image,as described above.

In the second aspect of the invention, the classification into thesubsets may be carried out with excluding a region in the radiographicimages having a radiation attenuation lower than a first reference valueand/or a region in the radiographic images having a radiationattenuation higher than a second reference value. The first referencevalue may be around 0 to exclude regions where the radiation hasscarcely attenuated. The second reference value may be around themaximum attenuation value to exclude regions where most of the radiationhas attenuated.

In the second aspect of the invention, only one subset may be extractedto apply the independent component analysis to the one subset to obtainthe separation factors, and the obtained separation factors may beapplied to the entire image. Alternatively, the images may be classifiedinto more than one subsets to apply the independent component analysisto each classified subset to obtain the separation factors for eachsubset, and the separation factors for each subset may be used as thepredetermined weighting factors to separate the image components.

The “bringing the radiographic images closer to achieving a relationshipwhere a ratio between radiation attenuations in the radiographic imagesis constant regardless of the thickness of each predetermined componentor the thickness of the subject” in the fourth aspect of the inventionmeans that, for example, in a relationship between the thickness of thesubject or each component of the subject and the X-ray exposure amount(log) shown in FIG. 12, achieving a relationship where a ratio betweenan X-ray attenuation E_(H) in the higher energy image and an X-rayattenuation E_(L) in the lower energy image of the radiographic imagesis constant regardless of the thickness of the subject or each componentof the subject.

In the fourth aspect of the invention, if the radiographic images areformed by a multi-shot method, the pixel value conversion may be carriedout to relatively increase, within regions having larger radiationattenuation in the radiographic images, a gain in one of theradiographic images formed by exposure to higher energy radiation sothat the gain in the one of the radiographic images becomes larger thana gain in the other of the radiographic images formed by exposure tolower energy radiation (see FIG. 15), or to relatively decrease a gainin one of the radiographic images formed by exposure to lower energyradiation so that the gain in the one of the radiographic images becomessmaller than a gain in the other of the radiographic images formed byexposure to higher energy radiation (see FIG. 18).

Further, in the fourth aspect of the invention, if the radiographicimages are formed by a one-shot method, the pixel value conversion maybe carried out to relatively decrease, within regions having largerradiation attenuation in the radiographic images, a gain in one of theradiographic images formed by exposure to higher energy radiation sothat the gain in the one of the radiographic images becomes smaller thana gain in the other of the radiographic images formed by exposure tolower energy radiation (see FIG. 18), or to relatively increase a gainin one of the radiographic images formed by exposure to lower energyradiation so that the gain in the one of the radiographic images becomeslarger than a gain in the other of the radiographic images formed byexposure to higher energy radiation (see FIG. 15).

Furthermore, in the fourth aspect of the invention, the “more than oneradiographic images” to be inputted to calculate the weighted sums maybe radiographic images subjected to the pixel value conversion orradiographic images before the conversion.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram illustrating the schematic configuration of amedical information system incorporating an image component separationdevice according to embodiments of the invention,

FIG. 2 is a block diagram schematically illustrating the configurationof an image component separating device and peripheral elementsaccording to a first embodiment of the invention,

FIG. 3 is a flow chart illustrating the flow of an image componentseparation process and relating operations according to the firstembodiment of the invention,

FIG. 4 is a block diagram schematically illustrating the configurationof an image component separating device and peripheral elementsaccording to a second embodiment of the invention,

FIGS. 5A and 5B show examples of a relationship between an attenuationcoefficient and a logarithmic radiation amount difference,

FIG. 6 is a flow chart illustrating the flow of an image componentseparation process and relating operations according to the secondembodiment of the invention,

FIG. 7 is a block diagram schematically illustrating the configurationof an image component separating device and peripheral elementsaccording to a third embodiment of the invention,

FIGS. 8A and 8B show one example of a relationship between a ratiobetween attenuation coefficients of each component in two radiographicimages and a logarithmic radiation amount difference,

FIGS. 9A and 9B show one example of frequency distributions ofcomponents to be separated for calculating mutual information,

FIGS. 10A and 10B show one example of different distributions of twovariables for different amounts of mutual information between thesevariables (10A shows a case where the mutual information=0.8 and 10Bshows a case where the mutual information=0),

FIG. 11 is a flow chart illustrating the flow of an image componentseparation process and relating operations according to the thirdembodiment of the invention,

FIG. 12 schematically shows a relationship between a thickness of asubject or each component of the subject and an X-ray exposure amount(log),

FIG. 13 schematically shows an influence exerted by scattered radiationon the relationship between the thickness of the subject or eachcomponent of the subject and the X-ray exposure amount (log),

FIG. 14 is a block diagram schematically illustrating the configurationof an image component separating device and peripheral elementsaccording to a fourth embodiment of the invention,

FIG. 15 shows one example of a look-up table for carrying out nonlineardensity conversion,

FIG. 16 is a flow chart illustrating the flow of an image componentseparation process and relating operations according to the fourthembodiment of the invention,

FIG. 17 shows a change in the relationship between the thickness of thesubject and the X-ray exposure amount (log) achieved by the nonlineardensity conversion carried out on a higher energy image,

FIG. 18 shows another example of the look-up table for carrying outnonlinear density conversion,

FIG. 19 shows a relationship between the thickness of the subject andthe X-ray exposure amount (log) with respect to radiographic imagesobtained through a one-shot method,

FIG. 20 is a block diagram schematically illustrating the configurationof an image component separating device and peripheral elementsaccording to a modification made on the embodiments of the invention,

FIG. 21 is a block diagram schematically illustrating the configurationof an image component separating device and peripheral elementsaccording to another modification made on the embodiments of theinvention, and

FIG. 22 is a block diagram schematically illustrating the configurationof an image component separating device and peripheral elementsaccording to yet another modification made on the embodiments of theinvention.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, embodiments of the present invention will be described withreference to the drawings.

FIG. 1 illustrates the schematic configuration of a medical informationsystem incorporating an image component separation device according toembodiments of the invention. As shown in the drawing, the systemincludes an imaging apparatus (modality) 1 for taking medical images, animage quality assessment workstation (QA-WS) 2, an image interpretationworkstation 3 (3 a, 3 b), an image information management server 4 andan image information database 5, which are connected via a network 19 sothat they can communicate with each other. These devices in the systemother than the database are controlled by a program that has beeninstalled from a recording medium such as a CD-ROM. Alternatively, theprogram may be downloaded from a server connected via a network, such asthe Internet, before being installed.

The modality 1 includes a device that takes images of a site to beexamined of a subject to generate image data of the images representingthe site, and adds the image data with accompanying information definedby DICOM standard to output them as the image information. Theaccompanying information may be defined by a manufacturer's (such as themanufacturer of the modality) own standard. In this embodiment, theimage information of the images taken with an X-ray apparatus andconverted into digital image data by a DR apparatus or a CR apparatus isused. The DR apparatus is formed by an X-ray generating unit and anX-ray detector, in which the X-ray generating unit emits an X-ray froman X-ray tube at a tube voltage applied by an X-ray high-voltagegenerating unit, and the X-ray transmitted through a subject is detectedby a flat panel detector (FPD) and converted into electric charges andstored to be converted into digital image data. The CR apparatus isformed by an X-ray imaging unit and an image reading unit. The X-rayimaging unit records radiographic image information of a subject on astorage phosphor sheet IP including a sheet-like storage phosphor layer.The image reading unit scans the storage phosphor sheet IP, whichcarries the image information recorded by the X-ray imaging unit, withexcitation light, such as laser light, to generate photostimulatedluminescence, and photoelectrically reads the obtained photostimulatedluminescence to obtain an analog image signal. Then, the analog imagesignal is subjected to logarithmic conversion and is digitalized togenerate digital image data. It should be noted that, in the embodimentsof the invention, it is preferred to use the DR apparatus when imagesformed through a multi-shot method are used. Other specific examples ofthe modality include CT (Computed Tomography), MRI (Magnetic ResonanceImaging), PET (Positron Emission Tomography), and ultrasonic imagingapparatuses. Further, imaging of a selectively accumulated contrastagent with the X-ray apparatus, or the like, may be carried out. Itshould be noted that, in the following description, a set of the imagedata representing the subject and the accompanying information thereofis referred to as the “image information”. That is, the “imageinformation” includes text information relating to the image.

The QA-WS2 is formed by a general-purpose processing unit (computer),one or two high-definition displays and an input device such as akeyboard and a mouse. The processing unit has software installed thereinfor assisting operations by the medical technologist. Through functionsimplemented by execution of the software program, the QA-WS2 receivesthe image information compliant to DICOM from the modality 1, andapplies a standardizing process (EDR process) and processes foradjusting image quality to the received image information. Then, theQA-WS2 displays the image data contained in the processed imageinformation and contents of the accompanying information on a displayscreen to prompt the medical technologist to check them. Thereafter, theQA-WS2 transfers the image information checked by the medicaltechnologist to the image information management server 4 via thenetwork 19, and requests registration of the image information in theimage information database 5.

The image interpretation workstation 3 is used by the imagingdiagnostician for interpreting the image and preparing an imageinterpretation report. The image interpretation workstation 3 is formedby a processing unit, one or two high-definition display monitors and aninput device such as a keyboard and a mouse. In the image interpretationworkstation 3, operations such as request for viewing an image to theimage information management server 4, various image processing on theimage received from the image information management server 4,displaying the image, automatic detection and highlighting orenhancement of an area likely to be a lesion in the image, assistance topreparation of the image interpretation report, request for registeringthe image interpretation report in an image interpretation report server(not shown) and request for viewing the report, and displaying the imageinterpretation report received from the image interpretation reportserver are carried out. The image component separation device of theinvention is implemented on the image interpretation workstation 3. Itshould be noted that the image component separation process of theinvention, and various other image processing, image quality andvisibility improving processes, such as automatic detection andhighlighting or enhancement, of a lesion candidate and image analysismay not be carried out on the image interpretation workstation 3, andthese operations may be carried out on a separate image processingserver (not shown) connected to the network 19, in response to a requestfrom the image interpretation workstation 3.

The image information management server 4 is formed by a general-purposecomputer having a relatively high processing capacity on which asoftware program, which implements a function of a database managementsystem (DBMS), is installed. The image information management server 4includes a large capacity storage forming the image information database5. The storage may be a large-capacity hard disk device connected to theimage information management server 4 via the data bus, or may be a diskdevice connected to a NAS (Network Attached Storage) or a SAN (StorageArea Network) connected to the network 19.

The image information database 5 stores the image data representing thesubject image and the accompanying information registered therein. Theaccompanying information may include, for example, an image ID foridentifying each image, a patient ID for identifying the subject, anexamination ID for identifying the examination, a unique ID (UID)allocated for each image information, examination date and time when theimage information was generated, the type of the modality used in theexamination for obtaining the image information, patient informationsuch as the name, the age and the sex of the patient, the examined site(imaged site), imaging information (imaging conditions such as a tubevoltage, configuration of a storage phosphor sheet and an additionalfilter, imaging protocol, imaging sequence, imaging technique, whether acontrast agent was used or not, lapsed time after injection of theagent, the type of the dye used, radionuclide and radiation amount), anda serial number or collection number of the image in a case where morethan one images were taken in a single examination. The imageinformation may be managed in a form, for example, of XML or SGML data.

When the image information management server 4 has received a requestfor registering the image information from the QA-WS2, the imageinformation management server 4 converts the image information into adatabase format and registers the information in the image informationdatabase 5.

Further, when the image management server 4 has received a viewingrequest from the image interpretation workstation 3 via the network 19,the image management server 4 searches through the records of imageinformation registered in the image information database 5 and sends theextracted image information to the image interpretation workstation 3which has sent the request.

As the user, such as the imaging diagnostician, requests for viewing animage for interpretation, the image interpretation workstation 3 sendsthe viewing request to the image management server 8 and obtains imageinformation necessary for the image interpretation. Then, the imageinformation is displayed on the monitor screen and an operation such asautomatic detection of a lesion is carried out in response to a requestfrom the imaging diagnostician.

The network 19 is a local area network connecting various devices withina hospital. If, however, another image interpretation workstation 3 isprovided at another hospital or clinic, the network 19 may include localarea networks of these hospitals connected via the Internet or adedicated line. In either case, the network 9 is desirably a network,such as an optical network, that can achieve high-speed transfer of theimage information.

Now, functions of an image component separation device and peripheralelements according to a first embodiment of the invention are describedin detail. FIG. 2 is a block diagram schematically illustrating theconfiguration and data flow of the image component separation device. Asshown in the drawing, this device includes a medium frequency componentextracting unit 21, an independent component analysis unit 22 and acomponent image generating unit 23.

The medium frequency component extracting unit 21 extracts imagecomponents (EM₁, EM₂) of a medium frequency band, which contains aspatial frequency band corresponding to the thickness of the bone of thehuman body, from the respective inputted radiographic images (E₁, E₂)using a filter, or the like, which is adjusted to extract a spatialfrequency component corresponding to the thickness of the bone of thehuman body depending on a pixel pitch (scanning resolution) of theimages. Specifically, the medium frequency component extracting unit 21generates a first blur image using a first filter which cuts spatialfrequency components having higher spatial frequencies than the spatialfrequency components corresponding to the thickness of the bone andgenerates a second blur image 2 using a second filter which cuts thespatial frequency components corresponding to the thickness of the boneand spatial frequency components having higher spatial frequencies thanthe spatial frequency components corresponding to the thickness of thebone, and then subtracts the second blur image from the first blur imageto obtain image components (EM₁, EM₂) of the medium frequency band.Alternatively, the image components (EM₁, EM₂) of the medium frequencyband may be obtained by using filters which cut spatial frequencycomponents having higher spatial frequencies than the spatial frequencycomponents corresponding to the thickness of the bone and those havinglower spatial frequencies than the spatial frequency componentscorresponding to the thickness of the bone. Further alternatively, theimages (EM₁, EM₂) of the medium frequency band may be extracted usingmultiresolution decomposition, in which the inputted image isdownsampled to obtain a medium resolution image, this medium resolutionimage is further downsampled to obtain a low resolution image, this lowresolution image is upsampled, and a difference between the upsampledlow resolution image and the medium resolution image is calculated toextract the medium frequency band images (EM₁, EM₂). The downsampling isachieved by using a Gaussian low-pass filter with σ=1 and ½ pixelskipping of the inputted images, and the upsampling is achieved by usingcubic B-spline interpolation.

The independent component analysis unit 22 carries out the independentcomponent analysis on inputted two pieces of image data, whichcorrespond to the observation signals, and calculates separation factorsfor separating the soft part component and the bone component, whichcorrespond to the independent components, from the images. In thisembodiment, explanation is given on an example using a Fast ICAalgorithm that estimates the independent components such that a negativeentropy is maximized using a fixed-point approach.

Assuming that pixel values of each pair of corresponding pixels betweenthe inputted two pieces of image data are x₁ and x₂, image componentsrepresenting the soft part component and the bone component to beseparated are y₁ and y₂, and mixing factors for the respective imagecomponents are a₁₁, a₁₂, a₂₁ and a₂₂, then, x₁ and x₂ can be expressedas equations (9) and (10) below:x ₁ =a ₁₁ y ₁ +a ₁₂ y ₂  (9),x ₂ =a ₂₁ y ₁ +a ₂₂ y ₂  (10).Rewriting the equations (9) and (10) as:

${X = \begin{pmatrix}x_{1} \\x_{2}\end{pmatrix}},{A = \begin{pmatrix}a_{11} & a_{12} \\a_{21} & a_{22}\end{pmatrix}},{Y = \begin{pmatrix}y_{1} \\y_{2}\end{pmatrix}},$then, equation (11) below is obtained:X=AY  (11).Therefore, assuming that an inverse matrix of the matrix A is W,equation (12) below is obtained:Y=WX  (12).Under this assumption, first, preprocessing to decorrelate theobservation signals is carried out as follows:Whitened data {tilde over (X)} of data X is obtained. Specifically, fordata X₀, which is obtained such that an average of the data X is 0, acovariance matrix thereof is:C_(X0)=E{X₀X₀ ^(T)}.Then, a matrix formed by eigenvectors e of C_(X0) is:E={e₁ . . . e_(n)}, anda diagonal matrix formed by eigenvalues d of C_(X0) is:D=diag(d ₁ . . . d _(n)),which are calculated using principal component analysis.Therefore, the whitened data {tilde over (X)} of the data X is obtainedby equation (13) below:{tilde over (X)}=D^(−1/2)E^(T)X₀  (13).Here, from E^(T)E=EE^(T)=I (I is a unit matrix) and C_(X0)=EDE^(T),E{{tilde over (X)}{tilde over (X)}^(T)}=D^(−1/2)E^(T)EDE^(T)ED^(−1/2)=I,and therefore {tilde over (X)} is white.

Then, suitable initial values of two load vectors w₁ and w₂, which formcomponents of the matrix W representing the separation factors, aredetermined using, for example, random numbers. At this time,standardization is carried out such as a norm of each vector is 1. Itshould be noted that W=(w₁, w₂)^(T).

Further, the next operations (a) and (b) are repeated until convergenceis reached. The convergence here refers to that, for each of w₁ and w₂,directions of the vector before and after update are about the same,i.e., a change in the value of updated w_(i) is sufficiently small.

(a) For i=1, 2, w_(i) is updated according to expression (14) below:w _(i) ←E{{tilde over (X)}g(w _(i) ^(T) {tilde over (X)})}−E{g′(w _(i)^(T) {tilde over (X)})}w _(i)  (14).Here, assuming that an approximation function of a density function ofthe restored signals according to the maximum entropy principle is G, gis a differential of G. For example, it is preferred that g(y)=tanh(ay), or may also be y exp(−y²/2) or y³. a is a constant that satisfies1≦a≦2, and 1 is often selected for a.

(b) W is updated such that the elements (w₁, w₂) of W are perpendicularto each other, according to expression (15) below:W←(WW ^(T))^(−1/2) W  (15).

Using the matrix W estimated through the above-described procedure, eachindependent component Y is estimated according to equation (16) below:Y=W{tilde over (X)}  (16).

Details of the above operations are disclosed, for example, in “Detailedexplanation of independent component analysis—New world of signalanalysis” (original title: Independent Component Analysis), written byHyvärinen et al, translated by Iku Nemoto and Masaki Kawakatsu, TokyoDenki University Press, February, 2005.

The component image generating unit 23 uses the inputted separationfactors as weighting factors to calculate weighted sums for eachcorresponding pixel between the inputted two images to generate twocomponent images representing the soft part component and the bonecomponent, respectively. That is, the inputted separation factors areapplied to all the spatial frequency bands to generate the soft partimage and the bone part image.

The corresponding pixels between the images may be identified bydetecting a structure, such as a marker or a rib cage, in the images andaligning the images with each other based on the detected structurethrough a known linear or nonlinear transformation using the detectedstructure as a reference. Alternatively, the two images may be takenwith an X-ray apparatus having an indicator for indicating timings forbreathing of the subject (see, for example, Japanese Unexamined PatentPublication No. 2005-012248) so that the two images are taken at thesame phase of breathing. In this case, the corresponding pixels cansimply be those at the same coordinates in the images, without need ofalignment between the images.

Now, workflow and data flow of the image interpretation using an imagecomponent separation process according to the first embodiment of theinvention are described with reference to the flow chart shown in FIG. 3and the block diagram shown in FIG. 2.

First, the imaging diagnostician carries out user authentication with auser ID, a password and/or biometric information such as a finger printon the image interpretation workstation 3 for gaining access to themedical information system (#1).

If the user authentication is successful, a list of images to beexamined (interpreted) based on an imaging diagnosis order issued by anordering system is displayed on the display monitor. Then, the imagingdiagnostician selects an examination (imaging diagnosis) containing theimages to be interpreted E₁, E₂ from the list of images to be examinedthrough the use of the input device such as a mouse. The imageinterpretation workstation 3 sends to the image information managementserver 4 a viewing request with image IDs of the selected images E₁ andE₂ as the search key. As the image information management server 4receives this request, the server 4 searches through the imageinformation database 5 and obtains image files (designated by the samesymbol E as the images, for convenience) of the images to be interpretedE₁, E₂, and sends the image files E₁ and E₂ to the image interpretationworkstation 3 that has sent the request. The image interpretationworkstation 3 receives the image files E₁ and E₂ (#2).

Then, the image interpretation workstation 3 analyzes the content of theimaging diagnosis order, and starts a process for generating componentimages S and B of the soft part component and the bone componentseparated from the received images E₁ and E₂, i.e., a program forcausing the image interpretation workstation 3 to function as the imagecomponent separation device according to the invention.

According to the started program, the medium frequency componentextracting unit 21 extracts the image components EM₁ and EM₂ of themedium frequency band respectively from the inputted radiographic imagesE₁ and E₂ (#3), the independent component analysis unit 22 carries outthe independent component analysis on the inputted two medium frequencyband images EM₁ and EM₂, which correspond to the observation signals, tocalculate separation factors W for separating the soft part componentand the bone component, which correspond to the independent components,from the images (#4), and the component image generating unit 23 usesthe separation factors W as the weighting factors to calculate weightedsums for each corresponding pixel between the original two radiographicimages E₁ and E₂ to generate the two component images S and Brepresenting the soft part component and the bone component (#5).

The generated component images S and B are displayed on the displaymonitor of the image interpretation workstation 3, and are used forimage interpretation by the imaging diagnostician.

As described above, in the medical information system incorporating theimage component separation device according to the first embodiment ofthe invention, the medium frequency component extracting unit 21extracts the image components EM₁ and EM₂ of the medium frequency band,which contains the spatial frequency band corresponding to the thicknessof the bone of the human body, from the inputted radiographic images E₁and E₂. Thus, the low frequency band (a spatial frequency bandcorresponding to structures which are thicker than the thickness of thebone of the human body), where the bone part component are hardlypresent, and the high frequency band, where the noise is dominant, ofthe original images E₁ and E₂ are excluded from the data to be inputtedto the independent component analysis unit 22, and the independentcomponent analysis is carried out only on the image components EM₁ andEM₂ of the medium frequency band, where much of the bone component andthe soft part component are present. This minimizes the influence of thenoise and improves the robustness of the operation to obtain theseparation factors W, thereby allowing separation of the soft partcomponent S and the bone part component B with higher accuracy.

FIG. 4 is a block diagram schematically illustrating the configurationof and data flow in an image component separation device according to asecond embodiment of the invention. As shown in the drawing, this deviceincludes a subset classifying unit 24, the independent componentanalysis unit 22 and the component image generating unit 23.

The subset classifying unit 24 classifies the pixels of the inputtedradiographic images into more than one subsets for each image based on avalue of a difference between logarithmic radiation amount values ofeach pair of corresponding pixels of the inputted two radiographicimages.

As mentioned above, in actual radiographic images, attenuationcoefficients of the soft parts and the bone parts are smaller atportions where the thickness of the subject is greater, due to influenceof the beam hardening. Therefore, in a single observation signal inlinear independent component analysis, the component signals are mixedwith different mixing factors, and subsets of the component signalswhich are mixed with different mixing factors act as noise to each otherduring estimation of the independent components.

It is known that the attenuation coefficient is dependent on adifference between logarithmic amounts of the inputted two radiographicimages, i.e., a difference between pixel values of each pair ofcorresponding pixels (see U.S. Pat. No. 6,421,419). FIG. 5A shows arelationship between an attenuation coefficient a of the soft part and alogarithmic radiation amount difference E₁₋₂, and FIG. 5B shows arelationship between an attenuation coefficient b of the bone part andthe logarithmic radiation amount difference E₁₋₂. These relationshipshave been obtained through experiments.

The subset classifying unit 24 calculates a difference between pixelvalues of each pair of corresponding pixels of the inputted tworadiographic images, and carries out histogram analysis on thecalculated differences to divide each of the inputted radiographicimages into more than one subsets. Thus, a correspondence relationshipbased on a correspondence relationship between the corresponding pixelsis also maintained between the subsets of the two radiographic images.

It should be noted that criteria for the division into the subsets maybe a ratio between values of each pair of pixels, or pixel values of oneof the inputted radiographic images may be used without any conversion,instead of the difference between values of each pair of pixels.

Operations carried out by the independent component analysis unit 22 andthe component image generating unit 23 are the same as those describedin the first embodiment.

Now, workflow and data flow of the image interpretation using an imagecomponent separation process according to the second embodiment of theinvention are described with reference to the flow chart shown in FIG. 6and the block diagram shown in FIG. 4.

First, similarly to the first embodiment, user authentication of theimaging diagnostician is carried out (#11), and the imagingdiagnostician selects and obtains images E₁ and E₂ to be interpreted(#12). Then, the image interpretation workstation 3 starts a program ofthe image component separation device according to the second embodimentof the invention, based on contents of an image diagnosis order.

According to the started program, the subset classifying unit 24classifies the inputted radiographic images E₁ and E₂ into more than onesubsets E_(1i), E_(2i) (i=1, 2, . . . ) based on the difference betweenpixel values of each pair of corresponding pixels of the images (#13).

The independent component analysis unit 22 carries out the independentcomponent analysis for each pair of corresponding subsets E_(1i) andE_(2i) to calculate the separation factors W_(i). Namely, first, “1” isset for the suffix i (#14), and the independent component analysis iscarried out on inputted subsets E₁₁ and E₂₁, and separation factors W₁are calculated for the subsets E₁₁ and E₂₁ (#15). Then, the suffix i isincremented by one (#16). If the suffix i has not exceeded a maximumvalue I_(MAX), i.e., the total number of the subsets (#17: NO),separation factors W₂ are calculated for the next pair of subsets E₁₂and E₂₁. Similarly, the operation to increment the suffix i (#16), andthe operation to calculate the separation factors W_(i) for inputtedsubsets E_(1i) and E_(2i) (#15) are repeated until the value of thesuffix i exceeds the maximum value I_(MAX).

If the value of the suffix i has exceeded the maximum value I_(MAX)(#17: YES), then, the component image generating unit 23 calculatesweighted sums for each corresponding pixel using the separation factorsW_(i) calculated for the pair of corresponding subsets E_(1i) andE_(2i). Thus, the two component images S and B representing the softpart component and the bone component are generated (#18).

The generated component images S and B are displayed on the displaymonitor of the image interpretation workstation 3, and are used forimage interpretation by the imaging diagnostician.

As described above, in the medical information system incorporating theimage component separation device according to the second embodiment ofthe invention, the subset classifying unit 24 classifies the pixels ofthe radiographic images E₁ and E₂ into the more than one subsets E_(1i),E_(2i) (i=1, 2, . . . ) based on a difference between pixel values ofeach pair of corresponding pixels of the inputted two radiographicimages E₁ and E₂, the independent component analysis unit 22 carries outthe independent component analysis for each pair of the classifiedsubsets E_(1i) and E_(2i), and the obtained separation factors W_(i) isused by the component image generating unit 23 to calculate weightedsums of the radiographic images for each pair of the subsets E_(1i) andE_(2i) to generate the component images S and B representing the softpart component and the bone part component. This eliminates theinfluence of the beam hardening, which is inherent to radiographicimages, and allows separation of the image components to be separatedwith higher accuracy.

It should be noted that, in this embodiment, the subset classifying unit24 may extract only a single pair of subsets E₁₁ and E₂₁ from the imagesE₁ and E₂, the independent component analysis unit 22 may carry out theindependent component analysis on the single pair of subsets E₁₁ and E₂₁to calculate the separation factors W₁, and the separation factors W₁may be applied to the entire images.

FIG. 7 is a block diagram schematically illustrating the configurationof and data flow in an image component separation device according to athird embodiment of the invention. As shown in the drawing, this deviceincludes a nonlinear independent component analysis unit 25 and acomponent image generating unit 23′.

The nonlinear independent component analysis unit 25 carries outnonlinear independent component analysis using a model which representsthe mixing factors (the mixing factors represent the mixing ratios ofthe image components of the soft parts and the bone parts in theinputted two radiographic images) as a predetermined function using, asa parameter, a difference between pixel values of each pair ofcorresponding pixels of the inputted two radiographic images, tocalculate the separation factors.

Assuming that the inputted two images are E₁ and E₂, the imagecomponents representing the soft part component and the bone componentto be separated are S and B, and the mixing factors (attenuationcoefficients) for these image components are a, b, c and d, then,relationships as expressed by equations (17) and (18) below areestablished, as described above:

$\begin{matrix}\left\{ \begin{matrix}{E_{1} = {{a\; S} + {b\; B}}} \\{E_{2} = {{c\; S} + {d\;{B.}}}}\end{matrix} \right. & {(17),\mspace{11mu}(18)}\end{matrix}$Transforming equations (17) and (18) to obtain the soft part image aSand the bone part image bB corresponding to the image E₁, equations (19)and (20) below are obtained:

$\begin{matrix}{{{aS} = {\left( {E_{1} - {\frac{b}{d}E_{2}}} \right)/\left( {1 - \frac{bc}{ad}} \right)}}{{bB} = {{\left( {E_{1} - {\frac{a}{c}E_{2}}} \right)/\left( {1 - \frac{ad}{bc}} \right)}\mspace{20mu}{\left( {= {E_{1} - {aS}}} \right).}}}} & {(19),\;(20)}\end{matrix}$

It is known, as mentioned above, that the attenuation coefficient isdependent on a difference between logarithmic amounts of the inputtedtwo radiographic images, i.e., a difference between pixel values of eachpair of corresponding pixels (see U.S. Pat. No. 6,421,419). Therefore,to express the respective attenuation coefficients with using functionsf_(a), f_(b), f_(c) and f_(d) of the logarithmic radiation amountdifference E₁₋₂, equations (17) and (18) are rewritten as equations (21)and (22) below:

$\begin{matrix}\left\{ \begin{matrix}{E_{1} = {{{f_{a}\left( E_{1 - 2} \right)}S} + {{f_{b}\left( E_{1 - 2} \right)}B}}} \\{E_{2} = {{{f_{c}\left( E_{1 - 2} \right)}S} + {{f_{d}\left( E_{1 - 2} \right)}{B.}}}}\end{matrix} \right. & {(21),\;(22)}\end{matrix}$Equations (21) and (22) imply that the mixing factors in the independentcomponent analysis are not always constant, and therefore, a linearindependent component analysis algorithm such as the above-describedFast ICA cannot be applied.

Here, focusing on the ratio a/c between the attenuation coefficients ofthe soft part in the two images and the ratio b/d between theattenuation coefficients of the bone part in the two images in equations(19) and (20), relationships between these ratios and the logarithmicradiation amount difference E₁₋₂ obtained through experiments are asshown in FIGS. 8A and 8B.

Approximating that the ratios a/c and b/d between the attenuationcoefficients are linear with respect to the logarithmic radiation amountdifference E₁₋₂, for the sake of simplicity, a/c=e+fE₁₋₂ andb/d=g+hE₁₋₂. Then, equations (19) and (20) are rewritten as equations(23) and (24) below:

$\begin{matrix}\left\{ \begin{matrix}{{a\; S} = \frac{E_{1} - {\left( {g + {h\; E_{1 - 2}}} \right)E_{2}}}{1 - {\left( {g + {hE}_{1 - 2}} \right)/\left( {e + {fE}_{1 - 2}} \right)}}} \\{{bB} = {\frac{E_{1} - {\left( {e + {f\; E_{1 - 2}}} \right)E_{2}}}{1 - {\left( {e + {f\; E_{1 - 2}}} \right)/\left( {g + {hE}_{1 - 2}} \right)}}.}}\end{matrix} \right. & {(23),\;(24)}\end{matrix}$

Thus, the independent components aS and bB can be estimated from the twoimages E₁ and E₂ by optimizing the parameters e, f, g and h such thatmutual information between aS and bB is minimized.

Assuming that aS=S′ and bB=B′, then the mutual information I(S′,B′)between S′ and B′ can be obtained according to equation (25) below:

$\begin{matrix}{{{I\left( {S^{\prime},B^{\prime}} \right)} = {{{H\left( S^{\prime} \right)} + {H\left( B^{\prime} \right)} - {H\left( {S^{\prime},B^{\prime}} \right)}} = {\sum\limits_{i,j}{{P_{S^{\prime}B^{\prime}}\left( {i,j} \right)} \times \log\frac{P_{S^{\prime}B^{\prime}}\left( {i,j} \right)}{{P_{S^{\prime}}(i)}{P_{B^{\prime}}(j)}}}}}},} & (25)\end{matrix}$where H represents entropy, P_(S′) and P_(B′) respectively representmarginal probability distributions of S′ and B′, and P_(S′B′) representsa joint probability distribution of S′ and B′. That is, P_(S′) (i)represents a probability of S′ taking a pixel value of “i”, which isobtained by “a number of pixels that take a pixel value of “i”/a totalnumber of pixels of the image data (S′)” from a histogram of the imagedata (S′). P_(B)′ (j) represents a probability of B′ taking a pixelvalue of “j”, and P_(S′B′) (i,j) represents a probability of S′ taking apixel value of “i” and B′ taking a pixel value of “j”, which areobtained in the similar manner to that for obtaining P_(S′) (i). Itshould be noted that, since P_(S′B′) (i,j) contains the two probabilityvariables “i” and “j”, a two-dimensional histogram is used.

The values of the parameters e, f, g and h for minimizing the mutualinformation I(S′,B′) can be determined by using, for example, simplexprocedure.

FIGS. 9A and 9B show one example of frequency distributions of S′ and B′for calculating the mutual information. FIG. 9A shows a frequencydistribution when the initial values are set for the parameters e, f, gand h, and FIG. 9B shows a frequency distribution after the parameterse, f, g and h are optimized. FIG. 10A shows a distribution of the twovariables in a case where the value of the mutual information betweenthe variables is about 0.8, and FIG. 10B shows a distribution of the twovariables in a case where the value of the mutual information betweenthe variables is 0. By minimizing the mutual information in this manner,correlation between the two variable S′ and B′ is lowered and thus thesevariables become components with higher independence.

It should be noted that the relationship between the logarithmicradiation amount difference E₁₋₂ and each of the ratios a/c and b/d ofthe attenuation coefficients may not be approximated as being linear,and may be approximated with a quadratic function, for example.

The component image generating unit 23′ assigns the values of theparameters e, f, g and h obtained by the nonlinear independent componentanalysis unit 25 and the difference E₁₋₂ between pixel values of eachpair of corresponding pixels of the inputted images E₁ and E₂ toequations (23) and (24) to calculate a pixel value of each pixel of thesoft part image S and the bone part image B.

Now, workflow and data flow of the image interpretation using an imagecomponent separation process according to the third embodiment of theinvention are described with reference to the flow chart shown in FIG.11 and the block diagram shown in FIG. 7.

First, similarly to the first embodiment, user authentication of theimaging diagnostician is carried out (#21), and the imagingdiagnostician selects and obtains the images E₁ and E₂ to be interpreted(#22). Then, the image interpretation workstation 3 starts a program ofthe image component separation device according to the third embodimentof the invention based on contents of an image diagnosis order.

According to the started program, the nonlinear independent componentanalysis unit 25 applies the above-described nonlinear independentcomponent analysis to the inputted images E₁ and E₂ and calculates theseparation factors W (the parameters e, f, g and h) (#23), and thecomponent image generating unit 23′ generates the two component images Sand B representing the soft part component and the bone component bycalculating a pixel value of each pixel of the soft part image S and thebone part image B based on the separation factors W and the differenceE₁₋₂ between pixel values of each pair of corresponding pixels of theimages E₁ and E₂ (#24).

The generated component images S and B are displayed on the displaymonitor of the image interpretation workstation 3, and are used forimage interpretation by the imaging diagnostician.

As described above, in the medical information system incorporating theimage component separation device according to the third embodiment ofthe invention, the nonlinear independent component analysis unit 25carries out the nonlinear independent component analysis using the modelwhich represents the mixing factors representing the mixing ratios ofthe image components of the soft parts and the bone parts in theinputted two radiographic images E₁ and E₂ as a predetermined functionusing, as a parameter, the difference E₁₋₂ between pixel values of eachpair of corresponding pixels of the inputted two radiographic images E₁and E₂, to calculate the separation factors W with taking the influenceof the beam hardening inherent to the radiographic images into account.Using the thus obtained separation factors W, separation of the imagecomponents to be separated can be achieved with higher accuracy.

FIG. 14 is a block diagram schematically illustrating the configurationof and data flow in an image component separation device according to afourth embodiment of the invention. As shown in the drawing, this deviceincludes a nonlinear density conversion unit 26, the independentcomponent analysis unit 22 and the component image generating unit 23.In this embodiment, it is assumed that the radiographic images E₁ and E₂are obtained by a two-shot method, i.e., obtained through two exposuresto radiations having different energy distributions, and the image E₁ isformed with the radiation having the higher energy distribution thanthat used for forming the image E₂. Hereinafter, the image E₁ isreferred to as the higher energy image E₁ and the image E₂ is referredto as the lower energy image E₂.

The nonlinear density conversion unit 26 carries out nonlinear densityconversion on the higher energy image E₁ to relatively increase the gainin a region having larger radiation attenuation, i.e., a region wherethe density value of the image is smaller (whiter), so that the gain inthe region in the higher energy image E₁ becomes larger than the gain inthe lower energy image E₂, and outputs a higher energy image E₁′subjected to the density conversion. FIG. 15 schematically illustrates alook-up table (LUT) used for carrying out the density conversion. As canbe seen, the conversion is carried to provide a “steeper” gradation atthe lower density side. In this embodiment, it is assumed that thedensity conversion is not carried out on the lower energy image E₂, or alinear density conversion is carried out on the lower energy image E₂.The higher energy image of the radiographic images E₁ and E₂ may bedetermined by referencing information, such as a tube voltage, containedin the accompanying information of each image, or may be specified bythe user in advance.

As mentioned previously, the two radiographic images obtained by thetwo-shot method do not have a relationship where a ratio between theradiation attenuations in the two radiographic images is constantregardless of the thickness of the components and the thickness of thesubject, since the higher energy image E₁ has lower linearity betweenthe X-ray exposure amount (log) and the thickness of the subject or thecomponents of the subject than the linearity in the lower energy imageE₂ due to influences of the beam hardening and the Compton scattering.This acts as noise in the following estimation of the independentcomponents in the independent component analysis.

The nonlinear density conversion is carried out to reduce influence ofthis effect acting as noise. By carrying out the above-described densityconversion on the higher energy image E₁ with focusing on a relationshipthat the smaller the pixel value (density value) of a region in theradiographic image (the higher energy image E₁ is used in thisembodiment), the greater the thickness of the subject in that region,correction to bring the images closer to achieving the relationshipwhere the ratio between the radiation attenuations in the tworadiographic images is constant regardless of the thickness of thecomponents and the thickness of the subject is achieved.

Operations carried out by the independent component analysis unit 22 andthe component image generating unit 23 are the same as those describedin the first embodiment.

Now, workflow and data flow of the image interpretation using an imagecomponent separation process according to the fourth embodiment of theinvention are described with reference to the flow chart shown in FIG.16 and the block diagram shown in FIG. 14.

First, similarly to the first embodiment, user authentication of theimaging diagnostician is carried out (#31), and the imagingdiagnostician selects and obtains images E₁ and E₂ to be interpreted(#32). Then, the image interpretation workstation 3 starts a program ofthe image component separation device according to the fourth embodimentof the invention based on contents of an image diagnosis order.

According to the started program, the nonlinear density conversion unit26 applies the nonlinear density conversion to the higher energy imageE₁ of the inputted radiographic images E₁ and E₂, and outputs theconverted higher energy image E₁′ (#33).

The independent component analysis unit 22 carries out the independentcomponent analysis on the converted higher energy image E₁′ and thelower energy image E₂ inputted thereto, which correspond to theobservation signals, and calculates the separation factors W forseparating the soft part component and the bone component, whichcorrespond to the independent components, from the images (#34). Thecomponent image generating unit 23 uses the separation factors W as theweighting factors to calculate weighted sums of each corresponding pixelbetween the converted higher energy image E₁′ and the lower energy imageE₂, to generate the two component images S and B representing the softpart component and the bone component (#35).

The generated component images S and B are displayed on the displaymonitor of the image interpretation workstation 3, and are used forimage interpretation by the imaging diagnostician.

As described above, in the medical information system incorporating theimage component separation device according to the fourth embodiment ofthe invention, the nonlinear density conversion unit 26 applies thenonlinear density conversion to the higher energy image E₁ to relativelyincrease the gain in a region having larger radiation attenuation, i.e.,a region where the density value of the image is smaller (whiter), sothat the gain in the region in the higher energy image E₁ becomes largerthan the gain in the lower energy image E₂, the independent componentanalysis unit 22 carries out the independent component analysis on theconverted higher energy image E₁′ and the lower energy image E₂, whichcorrespond to the observation signals, to calculate the separationfactors W, and the component image generating unit 23 uses theseparation factors W as the weighting factors to generate the componentimages S and B representing the soft part component and the bone partcomponent. This eliminates the influence of the beam hardening inherentto radiographic images, thereby allowing separation of the imagecomponents to be separated with higher accuracy.

FIG. 17 schematically shows a change in the relationship between thelogarithmic X-ray exposure amount (density of each radiographic image)and the thickness of the subject achieved by the above-describednonlinear density conversion. As can be seen, before the correction bythe nonlinear density conversion unit 26 (indicated by the short dashedline), a ratio between an X-ray attenuation E_(H) in the higher energyimage E₁ and an X-ray attenuation E_(L) in the lower energy image E₂varies depending on the thickness of the subject. In contrast, after thecorrection by the nonlinear density conversion unit 26 (indicated by thealternate long and short dash line), the ratio between the X-rayattenuation E_(H) in the higher energy image E₁ and the X-rayattenuation E_(L) in the lower energy image E₂ is nearly constant.

It should be noted that, the nonlinear density conversion unit 26 inthis embodiment may use a look-up table schematically shown in FIG. 18to apply nonlinear density conversion to the lower energy image E₂ torelatively decrease the gain in a region having larger radiationattenuation (a region where the density values of the image is smaller(whiter)) so that the gain in the region in the lower energy image E₂becomes smaller than the gain in the higher energy image E₁ (i.e., toprovide a “gentler” gradation). In this case, the higher energy image E₁may not be subjected to density conversion, may be subjected to lineardensity conversion, or may be subjected to the nonlinear densityconversion shown in FIG. 15.

Further, in this embodiment, the two radiographic images to be inputtedare obtained through the two-shot method. In a case of radiographicimages obtained through a one-shot method, direction of the nonlineardensity conversion is different. For example, when images are formed ontwo IPs with a copper plate disposed therebetween by being exposed toradiation once, as an example of the one-shot method using a CRapparatus, a higher energy image (which was placed behind the copperplate) has higher linearity than a lower energy image (which was placedbefore the copper plate), as can be seen from a relationship between thelogarithmic X-ray exposure amount and the thickness of the subjectschematically shown in FIG. 19 (the short dashed line indicates thehigher energy image and the solid line indicates the lower energy imageobtained in the one-shot method). This is because that, in the one-shotmethod, nearly the same level of influence is exerted by scatteredradiation both to the higher and lower energy images, and the higherenergy image has higher monochromaticity due to the fact that theradiation has transmitted through the copper plate, and therefore theinfluence of beam hardening is greater in the lower energy image than inthe higher energy image.

Therefore, in the case of the radiographic images obtained by theone-shot method, it is necessary to carry out density conversion whichis inverse to that carried out on the images obtained by the two-shotmethod. Namely, in this case, the nonlinear density conversion unit 26uses the look-up table schematically shown in FIG. 15 to apply thenonlinear density conversion to the lower energy image E₂ to relativelyincrease the gain in the region having larger radiation attenuation,i.e., the region where the density value of the image is smaller(whiter), so that the gain in the region in the lower energy image E₂becomes larger than the gain in the higher energy image E₁ (i.e., toprovide a “steeper” gradation). Thus, the logarithmic X-ray exposureamount in the lower energy image E₂ is changed as indicated by thealternate long and short dash line in FIG. 19. After the conversion, theratio between the X-ray attenuation E_(H) in the higher energy image E₁and the X-ray attenuation E_(L) in the lower energy image E₂ is nearlyconstant regardless of the thickness of the subject. Therefore,similarly to the case of the radiographic images obtained by thetwo-shot method, the influence of the beam hardening inherent toradiographic images can be eliminated and separation of the imagecomponents to be separated with higher accuracy can be achieved.

Alternatively, the nonlinear density conversion unit 26 may use thelook-up table schematically shown in FIG. 18 to apply the nonlineardensity conversion to the higher energy image E₁ to relatively decreasethe gain in the region having larger radiation attenuation, i.e., aregion where the density value of the image is smaller (whiter), so thatthe gain in the region in the higher energy image E₁ becomes smallerthan the gain in the lower energy image E₂ (i.e., to provide a “gentler”gradation).

Furthermore, in this embodiment, although the component image generatingunit 23 generates the two component images S and B representing the softpart component and the bone component from the density-converted higherenergy image E₁′ and the lower energy image E₂, the component imagegenerating unit 23 may generate the component images S and B from theradiographic image E₁ before the density conversion and the radiographicimage E₂.

In the above-described embodiments, although the process to separate thetwo image components representing the two components including the softparts and the bones is carried out on the inputted two radiographicimages, the above-described embodiments may be applied to a process forseparating three or more image components representing three or morecomponents from three or more inputted radiographic images. In thiscase, the number of components to be separated has to be not more thanthe total number of radiographic images to be inputted.

It may also be considered that, in the above-described embodiments, aregion containing the bones may be detected using a known imagerecognition process, and images of the region containing the bonestogether with the soft parts may be used as the input for theindependent component analysis. By inputting the images containing boththe independent components to be separated (soft parts and bones) inthis manner, the precondition on the observation signals in theindependent component analysis that the observation signals have tocontain all the component signals to be separated can more appropriatelybe satisfied, and therefore separation of the image components to beseparated with higher accuracy can be achieved.

Alternatively, the user may specify the region on which he or she wantsto carry out the separation, and the specified region may be used as theinput to carry out the independent component analysis.

Further, regions in the radiographic images to be inputted where theradiation has scarcely attenuated and regions where most of theradiation has attenuated may be excluded. This removes regions which actas noise to the independent components, such as soft parts and bones, tobe separated during the independent component analysis, therebyimproving accuracy of the separation.

It should be noted that, besides the description given above, variousmodifications made on the system configurations, the process flows, thetable structures, the user interfaces, or the like, of the embodimentswithout departing from the spirit and scope of the invention areintended to be encompassed within the technical scope of the invention.Further, the above-described embodiments are provided only by way ofexamples, and should not be construed as limiting the technical scope ofthe invention.

For example, as shown in the block diagram of FIG. 20, the firstembodiment and the second embodiment may be combined so that the mediumfrequency component extracting unit 21 extracts the image components EM₁and EM₂ of the medium frequency band from the inputted radiographicimages E₁ and E₂, the subset classifying unit 24 classifies the pixelsof the image components EM₁ and EM₂ into more than one subsets EM_(1i),EM_(2i) (i=1, 2, . . . ) based on a difference between pixel values ofeach pair of corresponding pixels of the extract image components EM₁and EM₂ of the medium frequency band, the independent component analysisunit 22 carries out the independent component analysis for each of theclassified subsets EM_(1i), EM_(2i), and the component image generatingunit 23 uses the obtained separation factors W_(i) to calculate weightedsums of the radiographic images for each of the subsets E_(1i) andE_(2i) of the inputted images E₁ and E₂, which correspond to the subsetsEM_(1i) and EM_(2i) of the medium frequency band, to generate thecomponent images S and B representing the soft part component and thebone part component.

Moreover, as shown in the block diagram of FIG. 21, the third embodimentmay further be combined to the above combination of the first and secondembodiments so as to carry out the nonlinear independent componentanalysis for each subset of the medium frequency band. In this case, thesubset classifying unit 24′ may reference, for example, the table shownin FIG. 8 representing the relationship between the logarithmicradiation amount difference E₁₋₂ and each of the ratio a/c of theattenuation coefficients of the soft parts and the ratio b/d of theattenuation coefficients of the bone parts, and may classify the imagecomponents EM₁, EM₂ of the medium frequency band into a subset ofregions which have a closer-to-linear relationship between theattenuation coefficients and the logarithmic radiation amount differenceE₁₋₂ and a subset of regions other than the above regions.

Furthermore, as shown in the block diagram of FIG. 22, the first, secondand fourth embodiments may be combined so that the nonlinear densityconversion unit 26 applies the nonlinear density conversion to thehigher energy image E₁ to relatively increase the gain in the regionhaving larger radiation attenuation, i.e., the region where the densityvalues of the image are smaller (whiter), so that the gain in the regionin the higher energy image E₁ becomes larger than the gain in the lowerenergy image E₂, the medium frequency component extracting unit 21extracts the image components EM₁′ and EM₂ of the medium frequency bandfrom the density-converted radiographic image E₁′ and the lower energyimage E₂, the subset classifying unit 24 classifies the pixels of theextracted image components EM₁′ and EM₂ into more than one subsetsEM_(1i)′, EM_(2i) (i=1, 2, . . . ) based on a difference between pixelvalues of each pair of corresponding pixels of the image components EM₁′and EM₂ of the medium frequency band, the independent component analysisunit 22 carries out the independent component analysis for each of theclassified subsets EM_(1i)′, EM_(2i), and the component image generatingunit 23 uses the obtained separation factors W_(i) to calculate weightedsums of the radiographic images for each of the subsets E_(1i)′ andE_(2i) of the images E₁′ and E₂ corresponding to the subsets EM_(1i)′and EM_(2i) of the medium frequency band to generate the componentimages S and B representing the soft part component and the bone partcomponent.

It should be noted that, in the above description, it is assumed thatlogarithmic conversion is applied to the obtained images before theoperations by the units 21-26 are carried out, and therefore, theprocess for separating the component images carried out by the componentimage generating unit 23 is expressed as the “weighted sum”. However, ifthe component images are separated from images which have not beensubjected to the logarithmic conversion, it is apparent that the sameresults as in the above description can be obtained by reading the “sum”in the above description as “product”, and the “difference” as“quotient”.

In the first aspect of the invention, before obtaining the separationfactors for separating the more than one image components from the morethan one radiographic images using the independent component analysis,an image component of a spatial frequency band containing each of themore than one components is extracted from each of the radiographicimages, the independent component analysis is carried out on theextracted image component, and the obtained separation factors are usedto calculate a weighted sum of the radiographic images to separate eachof the more than one image components respectively representing morethan one predetermined components in the subject. The extracted imagecomponents of the spatial frequency bands more appropriately satisfy theprecondition on the observation signals in the independent componentanalysis that the observation signals have to contain all the componentsignals to be separated, and thus separation of the image components tobe separated with higher accuracy can be achieved.

For example, in a case where image components representing the bonecomponent and the soft part component are separated from theradiographic images of a human body, image component of the mediumfrequency band including the spatial frequency band corresponding to thethickness of the bone of the human body can be extracted so that the lowfrequency band where the bone part component is scarcely present (aspatial frequency band corresponding to structures which are thickerthan the thickness of the bone of the human body) and the high frequencyband where noise is dominant are excluded from the data inputted for theindependent component analysis, and only the image component of themedium frequency band where much of the bone component and the soft partcomponent are present is inputted. This minimizes influence of noise inthe independent component analysis, and increases robustness of theoperation to obtain the separation factors. Explaining from a differentpoint of view, in the human body, the bones are usually not presentwhere no soft tissue is present, and the bones are likely to be presentwhere the soft tissues are relatively thick. That is, these two tissueshave a strong correlation in the low frequency band, and this lowers theindependence between these tissues. Therefore, by removing the frequencyband which is lower than the frequency band corresponding to thethickness of the bone, the independence between these two tissues can beincreased, thereby facilitating the separation.

In radiographic images obtained by actual imaging, if the radiationapplied to the subject is not monochromatic and is distributed over acertain energy range, a phenomenon called beam hardening occurs, inwhich the energy distribution of the applied radiation varies dependingon the thickness of each component in the subject, and therefore, theattenuation coefficient in each component differs from pixel to pixel.Explaining in more detail, the attenuation coefficient in an X-rayenergy range in which the Compton effect is dominant (an X-ray energyrange in typical imaging of around 40-150 kVp) monotonically decreasesas the thickness of other components increases. For example, in a caseof the chest of the human body, the attenuation coefficient within thelung field differs from that in the mediastinum. In the (linear)independent component analysis, if the component signals are mixed withdifferent mixing factors in a single observation signal, subsets of thecomponent signals mixed with the different mixing factors act as noiseto each other during estimation of the independent components.

Therefore, according to the second aspect of the invention, before theindependent component analysis is applied to obtain the separationfactors for separating the more than one image components from theradiographic images, pixels of the radiographic images are classifiedinto one or more subsets for each of the radiographic images based on avalue of a parameter, which is obtained from at least one of theradiographic images, having a predetermined relationship with thethickness of each of the more than one predetermined components or thethickness of the subject at each pixel of each of the radiographicimages. Then, the independent component analysis is carried out on atleast one pair of the classified subsets of the radiographic images. Theobtained separation factors are used to calculate weighted sums of theradiographic images or each pair of the subsets to separate the morethan one image components respectively representing the more than onepredetermined components in the subject. This prevents the componentsignals mixed with different mixing factors due to the influence of thebeam hardening, which is inherent to the radiographic images, fromacting as noise, and allows separation of the image components to beseparated with higher accuracy.

According to the third aspect of the invention, when the separationfactors for separating the more than one image components from theradiographic images are obtained using the independent componentanalysis, the model representing the mixing factors, which representsthe mixing ratios between the more than one image components in theradiographic images, as a predetermined function using a parameter,which is obtained from at least one of the radiographic images and has apredetermined relationship with the thickness of each of the more thanone predetermined components or the thickness of the subject at eachpixel of the radiographic images, is used. Therefore, the nonlinearindependent component analysis is carried out with taking the influenceof the beam hardening inherent to radiographic images into account,thereby allowing separation of the image components to be separated withhigher accuracy.

In a case of radiographic images formed by the multi-shot method, thedecrease rate of the X-ray exposure amount decreases as the thickness ofthe subject increases due to the influence of beam hardening, as can beseen from the relationship between the thickness of the subject and theX-ray exposure amount schematically shown in FIG. 13. Therefore, therelationship between the X-ray exposure amount (log) and the thicknessof the subject or each component of the subject is not linear both inthe image formed with higher energy X-ray and the image formed withlower energy X-ray. Further, since the X-ray at the higher energy sideat which the Compton effect is more dominant generates more scatteredradiation, the scattered radiation increases as the thickness of thesubject increases, and the decrease rate of the X-ray exposure amountbecomes further smaller than the X-ray at the lower energy side. Thealternate long and short dash line in FIG. 13 represents a case wherethe scattered radiation of the X-ray at the higher energy side is aboutthe same as that of the lower energy side, and the short dashed line inFIG. 15 represents a case of the X-ray at the higher energy sidecontaining actual scattered radiation.

On the other hand, as described above, it is assumed in the (linear)independent component analysis that the component signals contained in asingle observation signal are mixed with the same mixing factor, andcomponent signals mixed with different mixing factors in a singleobservation signal act as noise to each other during estimation of theindependent components.

Therefore, the fourth aspect of the invention focuses on the fact that,when the image components in the radiographic images are separated, evenif the component signals in a single observation signal are not mixedwith the same mixing factor, it suffices if a condition that the ratiobetween radiation attenuations in the radiographic images is constantregardless of the thickness of each component or the thickness of thesubject is satisfied. In the fourth aspect of the invention, a pixelvalue of each pixel of at least one of the radiographic images isnonlinearly converted based on a value of a parameter having apredetermined relationship with the thickness of each of the more thanone predetermined components or the thickness of the subject at eachpixel of the radiographic images so that the images are brought closerto achieving the above-described condition. This prevents the componentsignals mixed with different mixing factors from acting as noise, andallows separation of the image components to be separated with higheraccuracy.

As described above, according to the invention, the problem inherent toradiographic images, which may occur when the independent componentanalysis technique is applied to energy subtraction carried out onradiographic images, is solved, and separation of the image componentsto be separated with higher accuracy can be achieved.

1. An image component separation device comprising: component separatingmeans for separating bone and soft tissues as predetermined componentsfrom more than one radiographic images inputted thereto, the imagecomponents respectively representing more than one predeterminedcomponents in a site to be examined of a human body, each radiographicimage being formed by radiation transmitted through the site, eachradiographic image representing degrees of transmission and attenuationthrough the site of each of different patterns of radiation havingdifferent energy distributions, the component separating meansseparating the image components by calculating weighted sums usingpredetermined weighting factors for each corresponding pixel among theradiographic images; and pixel value converting means for applyingnonlinear conversion to a pixel value of each pixel of at least one ofthe radiographic images based on a value of a parameter obtained from atleast one of the radiographic images, the parameter having apredetermined relationship with a thickness of each of the more than onepredetermined components or a thickness of the site at each pixel of theradiographic images, the nonlinear conversion bringing the radiographicimages closer to achieving a relationship where a ratio betweenradiation attenuations in the radiographic images is constant regardlessof the thickness of each predetermined component or the thickness of thesite, wherein the component separating means carries out independentcomponent analysis on the image converted by the pixel value convertingmeans to obtain separation factors for separating the bone and softtissues as predetermined components from the converted images and usesthe separation factors as the predetermined weighting factors, whereinthe radiographic images are formed by a multi-shot method in whichimaging is carried out more than once using different patterns ofradiations having different energy distributions, and wherein the pixelvalue converting means carries out to relatively increase, withinregions having larger radiation attenuation in the radiographic images,a gain in one of the radiographic images formed by exposure to higherenergy radiation so that the gain in the one of the radiographic imagesbecomes larger than a gain in the other of the radiographic imagesformed by exposure to lower energy radiation.
 2. The image componentseparation device according to claim 1, wherein the parameter is any oneof a radiation amount at each pixel of one of the radiographic images, alogarithmic value of the radiation amount, a difference betweenlogarithmic values of radiation amounts at each pair of correspondingpixels between two of the radiographic images, and a logarithmic valueof a ratio between radiation amounts at each pair of the correspondingpixels.
 3. The apparatus in claim 1, wherein the regions correspondingto larger radiation attenuation correspond to regions having largerthickness of body structure within the site.
 4. An image componentseparation device comprising: component separating means for separatingbone and soft tissues as predetermined components from more than oneradiographic images inputted thereto, the image components respectivelyrepresenting more than one predetermined components in a site to beexamined of a human body, each radiographic image being formed byradiation transmitted through the site, each radiographic imagerepresenting degrees of transmission and attenuation through the site ofeach of different patterns of radiation having different energydistributions, the component separating means separating the imagecomponents by calculating weighted sums using predetermined weightingfactors for each corresponding pixel among the radiographic images; andpixel value converting means for applying nonlinear conversion to apixel value of each pixel of at least one of the radiographic imagesbased on a value of a parameter obtained from at least one of theradiographic images, the parameter having a predetermined relationshipwith a thickness of each of the more than one predetermined componentsor a thickness of the site at each pixel of the radiographic images, thenonlinear conversion bringing the radiographic images closer toachieving a relationship where a ratio between radiation attenuations inthe radiographic images is constant regardless of the thickness of eachpredetermined component or the thickness of the site, wherein thecomponent separating means carries out independent component analysis onthe image converted by the pixel value converting means to obtainseparation factors for separating the bone and soft tissues aspredetermined components from the converted images and uses theseparation factors as the predetermined weighting factors, wherein theradiographic images are formed by a multi-shot method in which imagingis carried out more than once using different patterns of radiationshaving different energy distributions, and wherein the pixel valueconverting means carries out to relatively decrease, within regionshaving larger radiation attenuation in the radiographic images, a gainin one of the radiographic images formed by exposure to lower energyradiation so that the gain in the one of the radiographic images becomessmaller than a gain in the other of the radiographic images formed byexposure to higher energy radiation.
 5. An image component separationdevice comprising: component separating means for separating bone andsoft tissues as predetermined components from more than one radiographicimages inputted thereto, the image components respectively representingmore than one predetermined components in a site to be examined of ahuman body, each radiographic image being formed by radiationtransmitted through the site, each radiographic image representingdegrees of transmission and attenuation through the site of each ofdifferent patterns of radiation having different energy distributions,the component separating means separating the image components bycalculating weighted sums using predetermined weighting factors for eachcorresponding pixel among the radiographic images; and pixel valueconverting means for applying nonlinear conversion to a pixel value ofeach pixel of at least one of the radiographic images based on a valueof a parameter obtained from at least one of the radiographic images,the parameter having a predetermined relationship with a thickness ofeach of the more than one predetermined components or a thickness of thesite at each pixel of the radiographic images, the nonlinear conversionbringing the radiographic images closer to achieving a relationshipwhere a ratio between radiation attenuations in the radiographic imagesis constant regardless of the thickness of each predetermined componentor the thickness of the site, wherein the component separating meanscarries out independent component analysis on the image converted by thepixel value converting means to obtain separation factors for separatingthe bone and soft tissues as predetermined components from the convertedimages and uses the separation factors as the predetermined weightingfactors, wherein the radiographic images are formed by a one-shot methodin which varying the energy distribution of the radiation transmittedthrough the site in the single exposure, and wherein the pixel valueconversion means carries out to relatively increase, within regionshaving larger radiation attenuation in the radiographic images, a gainin one of the radiographic images formed by exposure to lower energyradiation so that the gain in the one of the radiographic images becomeslarger than a gain in the other of the radiographic images formed byexposure to higher energy radiation.
 6. An image component separationmethod comprising the steps of: component separating to separate boneand soft tissues as predetermined components from more than oneradiographic images inputted thereto, the image components respectivelyrepresenting more than one predetermined components in a site to beexamined of a human body, each radiographic image being formed byradiation transmitted through the site, each radiographic imagerepresenting degrees of transmission and attenuation through the site ofeach of different patterns of radiation having different energydistributions, the component separating step including separating theimage components by calculating weighted sums using predeterminedweighting factors for each corresponding pixel among the radiographicimages; and prior to the above step, pixel value converting to applynonlinear conversion to a pixel value of each pixel of at least one ofthe radiographic images based on a value of a parameter obtained from atleast one of the radiographic images, the parameter having apredetermined relationship with a thickness of each of the more than onepredetermined components or a thickness of the site at each pixel of theradiographic images, the nonlinear conversion bringing the radiographicimages closer to achieving a relationship where a ratio betweenradiation attenuations in the radiographic images is constant regardlessof the thickness of each predetermined component or the thickness of thesite, wherein the component separating step includes carrying outindependent component analysis on the image converted in the pixel valueconverting step to obtain separation factors for separating the bone andsoft tissues as predetermined components from the converted images anduses the separation factors as the predetermined weighting factors,wherein the radiographic images are formed by a multi-shot method inwhich imaging is carried out more than once using different patterns ofradiations having different energy distributions, and wherein the pixelvalue converting comprises relatively increasing, within regions havinglarger radiation attenuation in the radiographic images, a gain in oneof the radiographic images formed by exposure to higher energy radiationso that the gain in the one of the radiographic images becomes largerthan a gain in the other of the radiographic images formed by exposureto lower energy radiation.
 7. A non-transitory computer-readablerecording medium containing an image component separation program forcausing a computer to carry out a component separation method, saidmethod comprising the steps of: component separating to separate boneand soft tissues as predetermined components from more than oneradiographic images inputted thereto, the image components respectivelyrepresenting more than one predetermined components in a site to beexamined of a human body, each radiographic image being formed byradiation transmitted through the site, each radiographic imagerepresenting degrees of transmission and attenuation through the site ofeach of different patterns of radiation having different energydistributions, the component separating step including separating theimage components by calculating weighted sums using predeterminedweighting factors for each corresponding pixel among the radiographicimages; and prior to the above step, pixel value converting to applynonlinear conversion to a pixel value of each pixel of at least one ofthe radiographic images based on a value of a parameter obtained from atleast one of the radiographic images, the parameter having apredetermined relationship with a thickness of each of the more than onepredetermined components or a thickness of the site at each pixel of theradiographic images, the nonlinear conversion bringing the radiographicimages closer to achieving a relationship where a ratio betweenradiation attenuations in the radiographic images is constant regardlessof the thickness of each predetermined component or the thickness of thesite, wherein the component separating step includes carrying outindependent component analysis on the image converted in the pixel valueconverting step to obtain separation factors for separating the bone andsoft tissues as predetermined components from the converted images anduses the separation factors as the predetermined weighting factors,wherein the radiographic images are formed by a multi-shot method inwhich imaging is carried out more than once using different patterns ofradiations having different energy distributions, and wherein the pixelvalue converting comprises relatively increasing, within regions havinglarger radiation attenuation in the radiographic images, a gain in oneof the radiographic images formed by exposure to higher energy radiationso that the gain in the one of the radiographic images becomes largerthan a gain in the other of the radiographic images formed by exposureto lower energy radiation.
 8. An image component separation devicecomprising: component separating means for separating bone and softtissues as predetermined components from more than one radiographicimages inputted thereto, the image components respectively representingmore than one predetermined components in a site to be examined of ahuman body, each radiographic image being formed by radiationtransmitted through the site, each radiographic image representingdegrees of transmission and attenuation through the site of each ofdifferent patterns of radiation having different energy distributions,the component separating means separating the image components bycalculating weighted sums using predetermined weighting factors for eachcorresponding pixel among the radiographic images; and pixel valueconverting means for applying nonlinear conversion to a pixel value ofeach pixel of at least one of the radiographic images based on a valueof a parameter obtained from at least one of the radiographic images,the parameter having a predetermined relationship with a thickness ofeach of the more than one predetermined components or a thickness of thesite at each pixel of the radiographic images, the nonlinear conversionbringing the radiographic images closer to achieving a relationshipwhere a ratio between radiation attenuations in the radiographic imagesis constant regardless of the thickness of each predetermined componentor the thickness of the site, wherein the component separating meanscarries out independent component analysis on the image converted by thepixel value converting means to obtain separation factors for separatingthe bone and soft tissues as predetermined components from the convertedimages and uses the separation factors as the predetermined weightingfactors, wherein the radiographic images are formed by a one-shot methodin which varying the energy distribution of the radiation transmittedthrough the site in the single exposure, and the pixel value conversionmeans carries out to relatively decrease, within regions having largerradiation attenuation in the radiographic images, a gain in one of theradiographic images formed by exposure to higher energy radiation sothat the gain in the one of the radiographic images becomes smaller thana gain in the other of the radiographic images formed by exposure tolower energy radiation.
 9. An image component separation methodcomprising the steps of: component separating to separate bone and softtissues as predetermined components from more than one radiographicimages inputted thereto, the image components respectively representingmore than one predetermined components in a site to be examined of ahuman body, each radiographic image being formed by radiationtransmitted through the site, each radiographic image representingdegrees of transmission and attenuation through the site of each ofdifferent patterns of radiation having different energy distributions,the component separating step including separating the image componentsby calculating weighted sums using predetermined weighting factors foreach corresponding pixel among the radiographic images; and prior to theabove step, pixel value converting to apply nonlinear conversion to apixel value of each pixel of at least one of the radiographic imagesbased on a value of a parameter obtained from at least one of theradiographic images, the parameter having a predetermined relationshipwith a thickness of each of the more than one predetermined componentsor a thickness of the site at each pixel of the radiographic images, thenonlinear conversion bringing the radiographic images closer toachieving a relationship where a ratio between radiation attenuations inthe radiographic images is constant regardless of the thickness of eachpredetermined component or the thickness of the site, wherein thecomponent separating step includes carrying out independent componentanalysis on the image converted in the pixel value converting step toobtain separation factors for separating the bone and soft tissues aspredetermined components from the converted images and uses theseparation factors as the predetermined weighting factors, wherein theradiographic images are formed by a one-shot method in which varying theenergy distribution of the radiation transmitted through the site in thesingle exposure, and the pixel value conversion means carries out torelatively decrease, within regions having larger radiation attenuationin the radiographic images, a gain in one of the radiographic imagesformed by exposure to higher energy radiation so that the gain in theone of the radiographic images becomes smaller than a gain in the otherof the radiographic images formed by exposure to lower energy radiation.10. A non-transitory computer-readable recording medium containing animage component separation program for causing a computer to carry out acomponent separation method, said method comprising the steps of :component separating to separate bone and soft tissues as predeterminedcomponents from more than one radiographic images inputted thereto, theimage components respectively representing more than one predeterminedcomponents in a site to be examined of a human body, each radiographicimage being formed by radiation transmitted through the site, eachradiographic image representing degrees of transmission and attenuationthrough the site of each of different patterns of radiation havingdifferent energy distributions, the component separating step includingseparating the image components by calculating weighted sums usingpredetermined weighting factors for each corresponding pixel among theradiographic images; and prior to the above step, pixel value convertingto apply nonlinear conversion to a pixel value of each pixel of at leastone of the radiographic images based on a value of a parameter obtainedfrom at least one of the radiographic images, the parameter having apredetermined relationship with a thickness of each of the more than onepredetermined components or a thickness of the site at each pixel of theradiographic images, the nonlinear conversion bringing the radiographicimages closer to achieving a relationship where a ratio betweenradiation attenuations in the radiographic images is constant regardlessof the thickness of each predetermined component or the thickness of thesite, wherein the component separating step includes carrying outindependent component analysis on the image converted in the pixel valueconverting step to obtain separation factors for separating the bone andsoft tissues as predetermined components from the converted images anduses the separation factors as the predetermined weighting factors,wherein the radiographic images are formed by a one-shot method in whichvarying the energy distribution of the radiation transmitted through thesite in the single exposure, and the pixel value conversion meanscarries out to relatively decrease, within regions having largerradiation attenuation in the radiographic images, a gain in one of theradiographic images formed by exposure to higher energy radiation sothat the gain in the one of the radiographic images becomes smaller thana gain in the other of the radiographic images formed by exposure tolower energy radiation.